Skip to content

Conversation

@SungJin1212
Copy link
Member

@SungJin1212 SungJin1212 commented Oct 10, 2025

This PR introduces a new parquet mode for the Store Gateway. In this initial version, the mode operates statelessly and does not perform operations such as block syncing. The primary improvement is to enhance cache utilization by leveraging the Store Gateway's block affinity.

Which issue(s) this PR fixes:
Fixes #6940

Checklist

  • Tests updated
  • Documentation added
  • CHANGELOG.md updated - the order of entries should be [CHANGE], [FEATURE], [ENHANCEMENT], [BUGFIX]

@SungJin1212 SungJin1212 marked this pull request as draft October 10, 2025 09:46
@SungJin1212 SungJin1212 force-pushed the parquet-gateway-poc branch 7 times, most recently from 27d4ca3 to 7ab5bc7 Compare October 15, 2025 06:44
@SungJin1212 SungJin1212 marked this pull request as ready for review October 15, 2025 09:40
assert.Equal(t, codes.InvalidArgument, s.Code())
}

func TestChunkToStoreEncoding(t *testing.T) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This test seems irrelevant?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we still want to keep this test?

@SungJin1212
Copy link
Member Author

@yeya24
I added some commits; the quay.io seems to be in the ' read-only` state temporarily.

@yeya24
Copy link
Contributor

yeya24 commented Oct 23, 2025

Can u please update the PR title and description?

@SungJin1212 SungJin1212 changed the title Parquet gateway poc Parquet Store gateway Oct 23, 2025
@SungJin1212 SungJin1212 force-pushed the parquet-gateway-poc branch 3 times, most recently from 336be55 to 553e4ea Compare October 24, 2025 02:04
yeya24 and others added 8 commits November 3, 2025 14:44
Signed-off-by: yeya24 <benye@amazon.com>
Signed-off-by: SungJin1212 <tjdwls1201@gmail.com>
Signed-off-by: SungJin1212 <tjdwls1201@gmail.com>
Signed-off-by: SungJin1212 <tjdwls1201@gmail.com>
Signed-off-by: SungJin1212 <tjdwls1201@gmail.com>
Signed-off-by: SungJin1212 <tjdwls1201@gmail.com>
Signed-off-by: SungJin1212 <tjdwls1201@gmail.com>
Signed-off-by: SungJin1212 <tjdwls1201@gmail.com>
Signed-off-by: SungJin1212 <tjdwls1201@gmail.com>
Signed-off-by: SungJin1212 <tjdwls1201@gmail.com>
Signed-off-by: SungJin1212 <tjdwls1201@gmail.com>
Signed-off-by: SungJin1212 <tjdwls1201@gmail.com>
Signed-off-by: SungJin1212 <tjdwls1201@gmail.com>
Signed-off-by: SungJin1212 <tjdwls1201@gmail.com>
Signed-off-by: SungJin1212 <tjdwls1201@gmail.com>
Signed-off-by: SungJin1212 <tjdwls1201@gmail.com>
Signed-off-by: SungJin1212 <tjdwls1201@gmail.com>
@yeya24
Copy link
Contributor

yeya24 commented Nov 3, 2025

For future PRs we may want to add the parquet metadata cache to store gateway and support #6991

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Support Parquet Store Gateway

2 participants